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IHTRODUCTIOei 



To facilitate the basic objectives of the various Consortium 
Research Development (CORD) projects t a specialised educational re- 
seardi training Institute was conducted for college professors who 
were currently participating in CORD projects* This group of pro-* 
lessors net at Teaching Research during the two week period^ 

August 20 to Septesber 1» 1967* The Institute was designed to prov- 
ide a set of learning experiences to the participants ^diich would 
increase their coitq;>etencles for improving their courses of instruc- 
tion through research and enable them to engender educational 
resear dh activities within their spheres of influence* 

Enpirlcal development of courses of instruction requires 
several specialized skills and utilizes a newly evolving knowledge 
base* The diversity of CORD institutions and backgrounds of par- 
ticipating professors suggested that considerable flexibility be 
programed into the Institute activities* With this in mlnd» pro- 
visions were made to Identify specific needs of each Institute 
participant followed with specific attention to as many such needs 
as time permitted* Prior to the termination of the institute, 
individualized programs of study were devised for each participant 
in each of his need areas thus enabling him to continue to pursue 
those topics on his own if he desired* 

Oblectives 



The specific objectives of the Training Institute were to 

develop competencies in the following areas: 

(a) Specifying objectives in behavioral criterion form* This in- 
cluded the statement of objectives for' instructional systems 
design purposes, -their modification and the refinement in 
developmental phases, and their revision and simplification 
for dissemination* 

(b) Task analysis and instructional specifications* This included 
information on hlerarChial task analysis and techniques for 
specifying instructional requirements of various kinds to 
achieve task related behaviors* 

(c) Instructional systems development* This included experimental 
operations and procedures, development of external control 
strategies, instructional monitoring procedures, and evaluation- 
revision operations to maximize the learning effects of each 
instructional element* 
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(d) Ifeasureinent. This included Inlcrnatlon on the procedures used 
in the selection end development of appropriate criterion mea- 
sures for various types of behavioral objectives* and techni<iues 
for assessing absolute criterion performance versus relative 
performance. 

(e) Research desigh* Included information on "within group" 

variance and the identification of learner variables relevant 
to the learning experience; manipulable and non-manipulable 
variables; types of research studies; alternative experimental 
designs; and operations research metliods. 

(f) Data analysis. This included selection of appropriate statis- 
tical techniques for analysis of evaluation and/or experimental 
data* and the use of computers in the process of analysis^ 

Proposal and report writing. This Included information as to 
the components of the research proposal* the use of operational 
language* and the key role of evaluation of the educational 
product* and/or the experiment itself — including limitations* 
Inferences* implications* and description of new questions 
raised and additional experimentation required. 

Trainees 

The training group consisted of a total of 61 participants* 
fifty-two of whom were college professors selected by the various 
D. S. Office of Education Regional Researdi Program Directors from 
those institutions of higher learning cooperating in the CORD 
program* and the remaining nine participants U. S. Office of fiduc^ 
•tion observors representing the Regional Researdi Program of the 
Bureau of Research. A complete roster of the Institute participants 
is contained in Appendix A. 

The participants represented a very diverse population of 
Interests. The breekdown by discipline Is as follows! 



English 


3 


Hi^er Education Adndnlatratlon 


10 


Psydiology 


2 


American Studies 


2 


History 


2 


Music 


X 


Mathematics 


4 


Education 


15 


Religion 


1 

e 


Communications 


1 


Natural Science 


2 



Sociology 

EeonoBico 

Speech 



Blologlcel Science 



Business 

Guidance 



4 

2 

1 

1 

1 

1 



Of the 52 college level participants » only four had never had 
a course In psychology; 21 had» at sons ttm, written and s«d>altted 
for funding at least one research proposal related to the Inprovenant 
of Instruction; and 19 of the 21 had been funded on at least one such 
proposal. 

DBSCBZPTIOM OF THE PBOGRAM 

Fre*inatltute preparations consisted of two major activities: 
Firsts the development of Instructional materials for use in the 
insti.tute; and second » the necessary communications to participants 
prior to the institute. 

Ihe Instructional materials development for the institute was 
undertaken by the institute staff under a separate research grant 
and resulted in a set of self-study Instructional materials. The 
complete set of self-study materials accompanies this report as 
Supporting Document A. 



Considerable communication with participants was necessary 
prior to the institute and consisted of four general mailings. The 
first mailing contained an Administrative Information Bulletin which 
covered oie following topics: Introduction to the institute, how 
participants were selected, housing, transporutlon, general infor- 
mation (mall, telephone, laundry, banking), stipends, food service, 
clothing, recreation, qu^;;tlons, social events, tentative institute 
schedule, dormitory Information, list of participants, and partici- 
pant questionnaire. A copy of the bulletin Is Included as 
Appendix B. 

The second mailing to each participant contained an updated 
participant list and Included names of Directors of Beglonal Be- 
seardi Programs, U. S. Office of Education, who would be attending. 
Also included were approxiiBately 15 brochures and maps of Oregon 
and the Northwest to help describe the area to the participants. 

The third mailing served to comflrm mode of travel and arrival 
time and gave instructions for aiaklng initial contact with institute 
representatives if arriving by airplane. A copy of this communica- 
tion is included as Appendix C. 



The fourth and final mailing sou^t social security Information 
from participants desiring to receive stipend payment during the 
institute* A copy of the memo is found in Appendix D* 

The Institute program was divided into two sections to provide 
£oy sjosTXer classes and more individualised attention to participants* 
Eadi section was given Identical instruction* 

Participants were randomly assigned to either S ection I or 
Section II, which permitted the opportunity of using a pre- post** 
test design for purposes of evaluating learning gains resulting from 
the institute* This activity will be more fully dlscucsed below 
under Evaluation* 

Because of the nature of the program it was expected that there 
would be a wide variance in the abilities and experiences of the 
participants* Therefore, the institute was designed to identify 
strengths and weaknesses of each participant in each topic area and 
to provide, as muth as possible, the necessary background experience 
and the individualised program required to make it an optimal 
learning experience for each participant* 

Participants were each provided the self-lnstructlonal materials 
for eadi topic and scheduled an opportunity to study the materials 
before the topic was presented by the institute staff* Each topic 
was presented in a group-paced programed sequence in the Teaching 
Research Automated Classroom C^RAC) • At the completion of the 
group-paced presentation, parttcipants were administered a criterion 
test for that topic in the TRAC system* Based on their scores on 
the criterion tests, participants were scheduled to either a small 
grotp seminar or individual instructional experience* Those Indlv* 
Iduals who achieved competence on each topic before the allotted 
time was expended undertook the preparation, on an Individual basis, 
of a research proposal relevant to their am area of interest* 

These individuals worked directly with the Institute Director or 
other assigned institute staff members* Individuals who did not 
develop criterion behavior by tlie end of the tine allotted for each 
topic were furnished by each topic specialist an individual reading 
list and other* materials necessary to continue their learning 
experience* 

Behavioral topics and staff manbers responsible for them were: 
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rjehavloral Topics Topic Specialists 

Specifying Objectives 

Task Analysis and Instructional Specification 
Instructional Systene Development 
Measurement 
Researdi Design 
Data Analysis I & II 
Proposal and Report Writing 

Topics were covered in sequence after an orientation and :verviei7 
session# The emphasis of the first week of the institute as indic- 
ated by the first three topics, primarily on the development of new 
instructional systems* The second week was devoted primarily to 
planning and implementing research on instruction and curriculum 
innovations* The institute was concluded with a summary and aval- 
i uation session* A typical daily schedule was as follows: 

8:00 - 9:45 A*M* Group-paced Topic Presentation in TRAC Facility 



Dr* Casper F* Paulson 
Dr* Paul Twelker 
Dr* Dale Hanreus 
Dr* Del Schalodc 
Dr* John Gordon 
Dr* James Bealrd 
Dr* Jack Crawford 



This was a carefully prepared, pre-tested, learning experience 
on one of the institute topics requiring active response from part- 
icipants and providing feedbadc to the presenter on the percentage 
of students responding correctly and an Individual record of errors 
made by each student* 

9:45 - 10:00 A*H* Break 

10:00 - 11:00 A*M« Administration of Criterion Test 

The scores on each topic criterion test were used to group stud- 
ents homogeneously for further study of each topic* 



11:00 - 12:00 Koon Independent and Small Group Study 

Individuals experiencing difficulty in common subtopics worked 
together under the guidance of staff member in an individual tut- 
orial, or eemlnar situation In order to gain competence In the 
specified behavior* 



12:00 - 1:30 P.M. Lunch 



1 

1:30 - 4:00 P*H* Independent and Si^ll Group Study 



This was a continuation of the work undertaken in the morning* 
Some individuals demonstrated sufficient competence in the topic 
to apply the behavior to the development of a research proposal 
relevant to his own area of interest* 
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4:00 5:00 P.M. Group Ileetlng (Interaction) 

A discussion session was held where Ideas of the day were ex* 
changed -- reactions, connents, questions, housekeeping details, 
etc« 



7:00 ** 10:00 Independent Study 

During this period the participant studied the specially pre- 
pared self-instructional materials on the topic scheduled for the 
following day* 

The complete Institute schedule for both sections Is contained 
in Appendix B* 

EVALUAIIOli 

Three forms of evaluation were employed: 1) a simple pre- post- 

test measure of criterion scores to determine what learning gains 
resulted from the institute; 2) participants* written appraisals ^ 
of the Institute on a prepared evaluation form; and 3) participants 
summary and evaluative comments obtained during the final two hour 
institute session devoted specifically to that purpose* Each of 
these evaluations will be summarized below. 

Evaluation 1: Pre- post- test gain scores 

The following design was established for the pre- post-test 
measure of evaluation* Prior to arrival. Institute participants 
were randomly assigned to either one of two sections* Section 1 
did not receive a pre-test, experienced the institute program, and 
was administered a post— test* Section 2 was pre-tested, exper- 
ienced the institute program, and did not receive the post- test* 

The results of pre- post-test scores on criterion measures for each 
institute topic, and total scores of all measures are shotm in 
Table 1* (Copies of pre- and post- tests for each topic arc con- 
tained in Appendix F*) 
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Table 1 






ERIC 



lfeans» Standard Deviations » Ranges* and Total Possible Points of All 
Separate Criterion Scores and Total Test Scores for Pre- and Post* 

test Measures. 



Total 



Criterion 

Measure 




N 


Mean 


Standard 

Deviation 


Ranse 


Points 

Possible 


Behavioral 


Pre 


24 


31.29 


11.16 


7-47 


60 


Objectives 


Post 


25 


50.88 


6.41 


35-58 




Objective 


Pre 


24 


10.67 


1.86 


7-14 


18 


Analysis 


Post 


25 


13.84 


2.51 


6-17 




Instructional 


Pre 


24 


15.08 


4.53 


10-22 


44 


Development 


Post 


25 


31.12 


6.74 


17-41 




Measurement 


Pre 


24 


12.52 


2.65 


8-16 


44 




Post 


25 


24.32 


4.05 


15.29 




Experimental 


Pre 


22 


1.45 


1.77 


0-6 


7 


Desian 


Post 


2} 


5.98 


1.25 


2-7 




Data 


Pre 


24 


6.50 


2.52 


1-11 


20 


Analvsis I 


Post 


25 


17.48 


2.20 


10-19 




Data 


Pre 


24 


1.58 


2.94 


0-8 


16 


Analvsis II 


Post 


24 


12.71 


2.50 


5-15_ 




Total* all 


Pre 


22 


79.38 


19.05 


41-115 


209 


Measures 


Post 


22 


156.75 


18.53 


104-17«^ 





Inspection of Table 1 reveals that post-test mean scores were 
higher than pre-test means in all cases. Although mean scores were 
not comparable between criterion measures* the smallest relative 
mean gain occurred in the Objective Analysis Section; whereas the 
greatest relative mean gain resulted in the Data Analysis II Section. 

Tests of significance were not made since the study did not involve 

hypothesis testing; however* the size of differences between means i 

for nearly all measures was sufficient to indicate that desirable 

changes in behavior did occur. | 

Evaluation 2i Individual Written Evaluation of the Institute . t 

The second form of evaluation required participants* at the 
close of the Institute* to complete an evaluation form containing 
five broad questions. Participants were requested to (1) rate the 
institute "warm blanket” services — housing* food* transportation* 
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etc. -*• (2) suggest Inprovements to the weekly sdiedule balance 
between group £iad independent study, tine for discussion, and se- 
quence of activities, (3) rate eadi topic presentation, (4) react 
to the idea of attending a research training institute, and (5) coinr 
nent on anything in general. A copy of the evaluation fom is 
contained in Appendix 6. 

Results of the first item indicated that all "warn blanket" 
services were, in general, good. Suggested improvements were 
varied and mostly personal in nature. One suggested improvement 
mentioned by several was to provide air condition in the dorm — 
to make "ole hot house" more bearable. 

Improvements suggested in item two were as varied as the back- 
grounds and experiences of the participants. Some argued for more 
group structure, others for more independent study; some wanted more 
structured discussion time, others less; some suggested different 
sequences of activities, others not. Outcomes from this item epit- 
omized the variability of Individual likes and wants* 

Participants rated ea<di Institute topic — the written portion 
and the group presentation — on a five point scale. Summaries of 
those ratings are shown in Table 2. 

TABLE 2 



Participants* Average Ratings On a 5 Point Scale of Each Institute 



we 

T(ffICS 


MRITTQI HACERIAIS 


GROUP PRESEMTATIOM 


Orientation 


4.1 




4.1 


Objectives 


3.9 




3.9 


Obj. analysis 


3.9 




3.5 


Measurement 


4.1 




4.3 


Ins. Sys. Devel. 


4.1 




4.1 


Res. Design 


4.1 




4el 


Data Anal. 1 


4.1 




4.3 


Data Anal. II 


4.3 




4.1 


Pronosal Writing 


4.7 




4.1 



From the above table It can be seen that participants rated 
nearly all topics and modes of instruction at about a four point 
level. One exception was that of the written materials for proposal 
writing. Ratings for this section averaged 4.7 nearly perfect. 

The high rating given the proposal writing written materials along 
with other general comments received in the institute suggests that 
participants were particularly Interested in obtaining these materials 
and felt they were a high priority need in their subsequent proposal 
writing efforts. 
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To summarize the results of the fourth item reactions to 
attending a research institute — > several typical comments folloi^: 

"As future research directors in our own institutions » we were 
made aware of some of the problems In research*” 

"The institute offers great opportunity to have expert instruc- 
tion concentrated in depth and supervised practice in applying net; 
skills in each area of research training*” 

"Provided us valuable material to bring home*” 

"Your impressive staff challenged and aided us*” 

"Would like to attend a longer session with more time to 
asslmulate*" 

"Would recommend to other faculty*" 

Responses to item five — general comments — were varied but* 
in general* did not offer additional information not already given* 
Comments ranged from "warm blanket" services* to amplification of 
topic materials* to elaboration on suggested scheduling alternatives* 

Evaluation 3; Group Oral Evaluations of the Institute 

The third form of evaluation consisted of a two hour group 
meeting with participants and staff to summarize and evaluate the 
institute* Again* as was noted earlier* the most notable outcome 
from this experience was the wide variance of difference among 
participants in terms of their opinions about the two weeks training 
just completed* Areas discussed were the written materials* class 
presentations* testing* pre-session activity* small group study* 
topic schedule sequencing* and participant grouping* 

Some participants felt that the various sections of the written 
materials should have mere editorial consistency* others argued to 
keep the individualization of authors* One suggestion commonly 
agreed upon was the desire to have a common example carried system- 
atically through each section of the written materials* No agreement 
could be readied, however* regarding what type of example should be 
used or what discipline should be represented* 

Many participants expressed a desire for some form of follow-up 
for advanced training* Suggestions were made for an advanced insti- 
tute* a pre-session at the National Convention of the American 
Education Research Association* and short sn»ll group regional train- 
ing sessions by the institute staff to be coordinated* whenever 
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possible, during any professional trips loade to different parts of 
the country. 

General agreement was expressed that more value than just per- 
sonal skill attainment emerged from the institute. Participants 
indicated that they acquired broader skills with which to help others 
at their home institutions in the preparation of proposals and the 
conduct of instructional research. 

GENERAL CONCLUSIONS 

On the basis of the evaluations just reviewed and the experience 
of the staff in carrying out the institute, the follo^Tlng conclusions 
have been made. Suggested changes, if a similar institute were to 
be conducted, are offered. 

a. Objectives. In general, the evidence supports the conclu- 
,sion that all objectives of the program were achieved. No major 

* dianges in objectives are recommended if the institute were repli- 
cated. 

b. Content. The content appeared appropriate for the part- 
icipants in attendance; however, additional attention to individual 
differences in small group activities would be desirable if a sub- 
sequent Institute were conducted. The development of diagnostic 
tests to be administered after participants experience each major 
topic, is recommended. The assessment of participants* behavior 
dianges resulting from such diagnostic testing would strengthen the 
system of guiding participants into small group and Independent 
study sessions* 

c. Trainees. Selection of the trainees was under the control 
of the Director of Regional Research Programs, U. S. Office of Educ- 
ation, and, therefore, was not the responsibility of the institute. 
Although a wide variety of discipline backgrounds and researdi 
es^eriences were combined in the training group, no unusual diffic- 
ulties emerged. Although no specific measurement of this relation- 
ship was made, informal reports from many trainees Indicated that 
desirable benefits accrued as a result of the interactions among 
sudi a diverse group. 



d. Organization. Although participants differed in their 
opinions about length of program, the conclusion drawn is that tt-70 
weeks was about the right amount of time to accomplish the objectives 
of the institute* If the program were to be conducted again, more 
detailed instruction to participants in their use of study time would 
perhaps be desirable. For example, although it was clearly announced 
at the orientation sesslor. that all trainees were free to do what 
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they felt was most helpful during the half day time periods devoted 
to small group study, few did anything different than attend the 
small groups to which they were assigned; yet several participants 
expressed a desire to have devoted this time period to other study 
efforts* It appears necessary to explicitly set forth various 
study alternatives available to trainees and counsel then Into 
which alternative they wish to select* 



e* Financial Summary* 



a* Trainee Support 

(1) Stipends and Travel 

(2) Dependency allowance 

b* Direct Costs 

(1) Personnel 

(2) Supplies 

(3) Equipment 

(4) Travel 

(5) Other 

c* Indirect Costs 
TOTAL 



Budgeted 


Expended* 


$ 17,500 


$ 17,120 


-0- 


-0- 


7,500 


7,000 


600 


460 


-0- 


-0- 


300 


230 


600 


460 


2,120 


2,000 


$ 28.620 


$ 27.270 



* (Not necessarily final figures) 



As it turned out, tlie budget was sufficient for the institute* 
However, if we had not had several cancellations from participants 
living a long distance away, we would have been overexpended In 
participant travel by approximately $2,500* 



Appendix A 

Institute Participants 



Section I 



Albritton^ Mr. Robert 
Oregon College of Education 

Andersent Or. Holger W. 

Le Moyne College 



342 S# Monmouth 
Nbninouth» Oregon 

3587 Covden Avenue 
MtophlSf Tenner jee 38111 



Sister Francis de Sales Boran 
Mar3mount College 

Cenmell^ Kathleen Miss 
U. S. Office of Education 
(Participant Observer) 

Hayea» Larry K. 

Oklahoma State University 

JexikSt Mr. John D. 

Wisconsin State University at 

Sister Mary Joela 
Madonna College 



2807 No. Glebe Road 
Arlington, Vlrijr^nJa 22207 

300 S. Garfield St« 
Arlington, Virginia 22204 



204 South Walnut 
Stillwater, Oklahoma 74074 

2107 Main St. 

Lacrosse • Wisconsin 54601 

36600 Schoolcraft 
Livonia, Michigan 48150 



Johnson, Dr. Noman C« 
N. C. College at Durham 



928 Plum St. 

Durham, North Carolina 27701 



Kerley, Mr. David E. 
Eastern Oregon College 



1904 1st Street 
LaGrande, Oregon 97850 



Kozma, Dr. Ernest 
Baldwin-Wallace College 

Lightsey, Dr. Ralph 
Georgia Southern College 

Mlsfeldt, Harlyn T. 

Stout State University 

Roberts, Mr. Barry 
University of Dayton 

Ruthenberg, Donald D« 
Illinois Wesleyan University 

Scfain, Dr. Naim A. 
SUW7*College at Fredonia 



8081 Worthington Pk. 
Strongsville, Ohio 44136 

P. 0, Box 731 
Statesboro, Georgia 30458 

1519 Hillsdale Road 

Eay Claire, Wisconsin 54701 

84 Tuxworth Road 
Centerville, Ohio 45459 

1209 N« Fell 

Bloomington, Illinois 61701 

59 College Street 
Fredonia, New York 14063 
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Section I Continued 



Shexnan» Mr* Matt 
Oregon Collego of Education 


4321 McKay Drive, So* 
Salem, Oregon 


Shipaian» Dr« ?• 6« 

M. C. College at Durham 


1029 Akron Avenue 

Durham 9 North Carolina 27707 


Siomons* Thomas W* 

St* Augustine College 


421 Hill St* 

Raleigh, North Carolina 27610 


Snider t Hr* Jack 
King College 


King College 

Bristol 9 Tennessee 37670 


Steward 9 Dr* Clifford 
Claremont Colleges 


Claremont Colleges 
Claremontf California 91711 


Stonemaut Dr* David K* 
Wisconsin State 


1226 W. Kay St* 

IThltewater, Wisconsin 53190 


Swegan* Dr« Donald B« 
BaldwlnrWallace College 


164 C* Center St* 
Berea, Ohio 44017 


Todd 9 Miss Leona £• 

Oregon College of Education 


2015 Wallace Bd« , N*W* 
Salem, Oregon 97304 


Van Cleve, Dr* William J* 
St* John^s University 


1128 24th Avenue, No* 

St* Cloud, Minnesota 56301 


Weltoni Mr* Richard 
Southern Oregon College 


810 Leonard St* 
Ashland, Oregon 97520 


Casey 9 Francis T* 
Marymount College 


1228 Providence Terrace 
McLean, Virginia 22101 


Knuth 9 Dr* William 

San Francisco State College 


Creative Arts Department 
San Francisco State College 
San Francisco, California 
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Ahearn^ Miss Mary Catherine 
Kary College 



Section IX 



1004 17th Avenue 
Menominee» Michigan 49858 



Beck» Mr, Robert F. 515 E« Cascade 

Wisconsin State University at River Falls River Falls. Wisconsin 54C22 



BuggSy Miss Mary J« 

Wisconsin State University at 
Stevens Point 

Coffman* Mr* Phillip H* 
Jamestown College 

Colmey* Or* James 
Memphis State University 

Downes* Dr* John 
Emory University 

En>7ay* Dr* Milton* K* 

Elmira College 

Fortune* Dr* Jimmie C* 
blemphls State Unl'/ersity 

Sister Caroline Mary Glllin 
Hercey College of Detroit 

Jacobson* Mr* John R* 

College Center of Finger Lakes 

Knuth* Dr* Alice 

Oregon College of Education 

Lee* Dr* Eugene 
Emory University 

McAllister* Mr* James 
Monmouth College 

Melville* Dr* George 
Knox College 

Monohan* Hr* Patrick 
Wisconsin State University at 
Whitewater 

Maaca* Dr* Donald 
SUiiY-College at Brockport 



802 Linwood Avenue 

Stevens Point* Wisconsin 54481 



Route 1 

Jamestown* North Dakota 58401 

4901 Roane Road 
Memphis* Tennessee 38117 

1995 Azalea Circle 
Atlanta* Georgia 

418 Euclid Avenue 
Elmira* New York 14905 

4872 Leven 

Memphis* Tennessee 38117 

8200 W* Outer Dr* 

Detroit* Michigan 48219 

22 W* 3rd St* 

Corning* New York 

Oregon College of Education 
Monmouth* Oregon 97361 

2967 Appling Way 
Chamblee* Georgia 30005 

1133 E* Broadway 
Monmouth . Illinois 61462 

1390 Spi ice 

Galesburg* Illinois 61401 

202 State Street 
Whitewater* Wisconsin 



34 Lynnwood 

Brockport* New York 14420 
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Section IX Continued 



STothelSt £&• John A. 
Yankton College 


1017 iktlberry 

Yankton, South Dakota 57078 


0o8tendorp> Dr» John A* 

Wisconsin State University at River Falls 


303 N* Dallaa 

River Falls, Wisconsin 54022 


Perrin^ Hr« Robert 
Jamestown College 


Jamestown College 
Jamestown, Worth Dakota 58401 


Rickards, Montana, Mrs* 
Oregon College of Education 


Oregon College of Education 
Monmouth, Gregory 97361 


Schmid, Hr* Ralph B* 
Emory University 


4190 Carrollwood Dr* 

Route 4 

Stone Mountain, Georgia 30083 


Shapiro, Dr* Jacob 
Le Moyne College 


377 Green Acres Road 
Memphis, Tennessee 38117 


Shute, Dr* Harlow 
Bennett College 


1115 Tuscaloosa St* 

Greensboro, North Carolina 27406 


Spanjer, Dr* R* Allen 
Portland. State College 


1390 S*E« Blakeney 
Beaverton, Oregon 97005 


Walker, Dr* Kenneth 
Oregon College of Education 


346 Walnut Drive 
Monmouth, Oregon 97361 



16 






^_. 



Regional Research Program Observers 
Taat Attended The Institute 

Director of Regional Research Program 
Dr« Paul Messier 
U« S* Office of Education 
Washington, D« C« 20202 

Directors of Educational Research 
USOE/DHEW Regional Offices 



Mr. John A. !lorro^^ 

Director of Educational Researdi 
Office of Educatlon/DHEW 
Regional Office III 
220 Seventh Street, N»B. 
Charlottesville, Virginia 22901 



Mr. Theodore !• Abell 
Director of Educational Research 
Office of Educatlon/DIIKTT 
Regional Office XV 
50 Seventh Street, N.E. 

Atlanta, Georgia 30323 



Mr. Joseph A. Humln 

Director of Educational Research 

Office of Educatlon/DHElv^ 

Regional Office V 

New Post Office Building 

433 West Van Buren Street 

Chicago, Illinois 6060? 



Dr. Harold A Hasvell 
Director of Educational Research 
Office of Educatlon/DHEW 
Regional Office ^711 
1114 Commerce Street 
Dallas, Texas 75202 



Dr. Levis R. Crum 

Director of Educational Research 

Office of Educatlon/DHEW 

Regional Office VIII 

Federal Office Building, Rm. 9017 

19th and Stout Streets 

Denver, Colorado 80202 



Dr. Walter Hlrsch 

Director of Educational Research 

Office of Education/DHK? 

Regional Office IX 

Federal Office Building, Rm. 250 

50 Fulton Street 

San Francisco, California 94102 



Dr. John Sokol 

c/o Regional Research Program 
USOE/DHEt^ 

Regional Office IX 
42 Broadway 

New York, N«7 York 10004 
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Dr. Richard McCann 
c/o Regional Research Program 
US0E/DHE^7 
Regional Office I 
John Fitzgerald Kennedy Federal 
Building 

Boston, Massachusetts 02203 
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for 

Participants in Consortium Research Development (CORD) Projects 



to be conducted by 
THE TEACHING RESEARCH DIVISION 
Oregon State System of Higher Education 



on the campus of the 

Oregon College of Education, Monmouth, Oregon 
August 20 through September 1, 1967 



July 5, 1967 
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1* Introduction 



This bulletin contains Infoxioatlon for personnel participating in the 
National Research Training Institute to be conducted by the Teaching 
Research Division of the Oregon State System of Higher Education on the 
campus of the Oregon College of Education in Monmouth, Oregon, from 
August 20 through September 1, 1967. The purpose of the institute is to 
provide a specialized educational research training program for college 
professors Who are currently participating In a CORD project. 

The first veek of the Institute vill be devoted primarily to applying 
new knowledge learned from research to the improvement of instruction, 
l.e«, to developing new Instructional systems. The second week will be 
devoted primarily to planning and conducting research on those instruc*- 
tlonal systems and reporting the research results. 

Much planning and preparation has gone into the development of a 
program that hopefully will provide for each participant the kind of 
experience that will be most relevant in Improving instruction in his 
discipline. The Teaching Research Automated Classroom (TRAC-faclllty) 
will be utilized for some Instruction and this will require dividing the 
institute into two major sections. Further sectioning will be done on 
other bases. To assist in this teek and other administrative concerns 
it is essential that you complete Appendix D (attached) and return it 
in the enclosed envelope immediately (before July 15, 1967). 
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2. Selection 

Participants were selected by the Director » Regional Research Progran, 
United States Office of Education. The Teaching Research Division has 
no authority In this matter. All questions with reference to Initial 
acceptance In the program or in changes In personnel to attend the National 
Research Trai n i n g Institute should be directed to Dr. Paul Messier 9 
Director, Regional Research Program, Department of Health, Education, and 
Welfare, Office of Education, Washington, D. C. 20202. 

Participants are from Wisconsin, Virginia, New York, Oregon, Tennessee, 
Georgia, North and South Dakota, North Carolina, Oklahoma, Michigan, Ohio, 
Illinois, Minnesota, and Iowa. A list of participants Is enclosed as 
Appendix C In the event that you have occasion to make personal pre- 
conference contacts. 

3. Hottslnfi 

Please see Appendix B. If you desire dormitory accomodations, please 
complete the enclosed application (attached to Appendix B) and return it 
with your check to the Director of Dormitories, Oregon College of Education, 
Monmouth, Oregon. Participant wives or husbands wishing dormitory units 
should also complete an application and return It with a check as above. 
There are two motels in Monmouth (Coopers and Vans) available to those 
participants who plan to bring dependent children. Both motels are not 
elegant but quite acceptable. Please write directly to these motels for 
reservations (Coopers Motel, Monmouth, Oregon, 97361, or Vans Motel, 
Monmouth, Oregon, 97361). 
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4. TrmsDortatlon 

Each participant vUl be reiid>uraed for one round trip between hla 
bone base and point of entry (Portland, Salem, or Monmouth, as 

■V 

beloir) at the rate of 8C per mile to be computed from standard auto 
ttlXeage charta- regardless of mode of trananortatloa . We expect to hare 
. ... your trcveX- relmlniraeoiect check available upon your arrival* Surface 
-transportation >dll be provided^ from Portland or Salem to Monmouth 
.Sunday,. August 20th* It Is. Important' that you provide ua with the .mode 
■•of -transportation aa well* as arrival tiffley point of entry, and train or 
flight number as -soon as possible (see.JppendlK. h)« Transportation in 
Monmo ut h will .be provided when n eces sary. 

S* General Information 

Mall Service : Mail is. delivered to the college twice daily; 

8 a*m* and 10 a*m*, .and Is piclced.up from.:.the college twice 
daily, 10 a.m* axul .2 p*m. • The Monmouth City Post Office la- 
open for window service until 5:15 p*m» and dispatches its 

. *• 

last dally outgoing mail at 5:30 p*m« Your mall addreaa 
while here will be; Arbuthnot Hall, Oregon College of 
Educa tion , Monmouth, Oregon, ...97361 • 

. b* Telephone: All calls,, local and long-distance, made from 
Arbuthnot Hall (dorm) must use pay phones* .Local and long- 
distance reverse charge business calls can be made from 
* - s college telephonea*. 

c* Latmdrv Service : Arbuthnot HaU provldea pay washer and 
dryers* ..Monmouth also has an excellent. laundry and dry- 

• I 

cleaning establishment as *«11 as a salf-aervlee laundromat* * 
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d. Banking Services ; Monmouth has the United States National 
Bank of Oregon to accomodate your banking needs. A roster 
of Institute participants has been given to the bank to 
assist with your identification. However » an officer of 
the bank suggests that participants might bring some form . 
of ID from their local banks as an added precaution; 

BankAmerlcards will serve equally well. 

6. Stipends 

Participant stipends will be $75.00 per week payable August 25th 
and September 1. No dependency allowance is allowed. 

7. Food Service 

All college meal and snack facilities will be closed during the dates 
of the Institute. Therefore, special arrangements have been made for 
meal service at two local restaurants, located a short walking distance 
from the campus. The food and service is excellent at both of these 
establishments as well as conservative in price. One features a buffet 
style that has been a favorite of past institute participants. 

8. Clothing 

During August and September the weather conditions in Oregon "normally” 
are most pleasant, with very little or no rain, warm to hot days, cool 
nights. You should bring clothing to keep you cool and comfortable. 
Institute dress will be casual; hov7ever, one social event will require 
tie and suit coat or sport jacket (Military Officer's Club). Don't forget 
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a sweater or light jacket for evenings -* it cools off! If you plan 
to visit the coast, bring clothing to accomodate gusty cool, moist air. 

A nylon jacket or similar wlndproof apparel is most comfortable. 

9. Recreation 

The Pacific Northwest has infinitely varied scenery. Lush meadow- 
lands lead to snowy mountain tops rising from green foothills, parklike 
valleys, and deep canyons. The coastal scenery is especially beautiful. 
Golfing, swimming, surfing, fishing, skiing, hiking, tennis, touring 
are all available. Indoor activity is available at the college gymnasium, 
and Monmouth has a city park with children's play equipment. 

During the mid-point weekend of the Institute, for those interested, 
trips will be planned to both the coast and the mountains. Bring any 
necessary gear or equipment you desire. Many recreational, equipment items 
can be rented here (golf clubs, surf and scuba equipment, skiing equipment, 
fishing equipment, etc.). Another packet will be mailed in the near 
future containing various brochures more fully describing Oregon's 
recreational and geographical features. 

10. Questions 

For any questions you may have or information you may seek, please 

write or call: Dr. Jack V. Edling, Director 

TEACHING RESEARCH DIVISION 
Monmouth, Oregon 97361 

Telephone: Area Code 503, No. 838-1220, Ext. 391 ' 
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11. Social Events 

Two social events have been planned to which all participants and 
their guests are invited. On Monday night » August 21 » 1967 » the 
Officer’s Club at the Adair Air Force Base» located only a few miles 
from Monmouth, has been reserved for those who would like to enjoy a 
unique social event. Transportation will be provided by the Institute. 

The Officer's Club has a large outdoor charcoal grill where each person 
can select and grill a magnificent New York cut steak to his own exact 
specifications (all of the other elements of the meal are prepared by 
the Club so you are assured of something to eat).!' The setting is 
ideal, and music and other entertainment will be provided. The charge 
is $3.00 payable at the time of checking in and will be in lieu of the 
evening meal which those not attending will purchase at a Monmouth 
restaurant* Bar service is available at the Club. 

On Thursday evening, August 31, the last evening before the termin- 
ation of the Institute, another social evening has been planned at a 
State Park, also just a few miles from Monmouth. The local Junior Chamber 
of Commerce specializes in a chicken barbeque with trimmings for approx- 
imately $1.50. This also is in lieu of the regular evening meal which 
could be purchased at a local restaurant for those who do not desire to 
attend. Transportation will be provided by the Institute. Entertainment 
details will be planned in cooperation with Institute participants. In 
order to make reservations, we are asking that you indicate whether you 
desire to attend these events on the enclosed Appendix D and return it 
to us at your very earliest convenience. 
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Tentative Schedule for the Institute 
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(Final program and self-study materials will be Issued In orientation session) 



Sunday 
August 20 



Monday 
August 21 



Tuesday 
August 22 



Wednesday 
August 23 



Thursday 
August 24 



Friday 
August 25 



Saturday 
August 26 

Sunday 
August 27 



All participants to be paid stipends are expected to arrive on 
Sunday, Aug. 20. Registration and dormitory checkin 8. a.m. to 10 p.m. 

8;00 - 11;30 a.m. liOQ -» 5;00 p.m. 7;O0 ~ lOtOQ p.m. 



Section I*-0rlentation 



Section II - 
Pre**Sesslon Evaluation 

Section I - Practice 
Session- Speplfyg' Obj 's 

Section II “ Ind. Study- 
Specifying Objectives 

Section I-Prac. Sess.- 
Test Construction 

Section Il-Small Grp. 
Sess. -Specifying Obj’s 

Section I-Prac.Sesslon- 
Obj .Anal.A. Instr. Spec's 

Section Il-Small Grp. 
Sess.-Test Construction 

Section I-Prac.Sess.- 
Instr. Systems Devel. 

Section II-Sml.Grp.Sess. 
Obj .Anal. & Instr. Spec's 

Trips to Pacific Coast c 



Independent Study * 
Specifying Objectives 

Orientation 



Small Group Session - 
Specifying Objectives 

Practice Session - 
Specifying Objectives 

Smedl Group Session - 
Test Construction 

Practice Session - 
Test Construction 

Small Grp. Session - 
Obj . Anal. &Instr. Spec's 

Prac . Sess . -Obj ect Ive 
Anal. & Instr. Spec's 

Small Grp. Session - 
Instr. Systems Dev. 

Practice Session - 
Instr. Systems Dev. 

Cascade Mountains, as 



Social Event 



Social Event 



Independent Study - 
Test Construction 

Independent Study 
Test Construction 

Ind . Study-Ob j ect Ive 
Anal. & Instr. Spec's 

Ind. Study-Objective 
Anal. & Instr. Spec's 

Ind. Study - Instr. 
Systems Development 

Ind. Study - Instr. 
Systems Development 

Independent Study - 
Research Design 

Independent Study - 
Research Design 

desired. 



Free Time. Individual arrangements. 



8 



8?00 Xl?30 



I;00 - StOO o.m. 



7;00 lOiOO Dam. 



^oday Sect ion I-^Prac.Sessw'- Small Group Session - Independent Study . .-* 

August 28 Research Design Research Design Data Analysis I 



Section ll^Small Grp. 
Sees . -Instr • Sys .Dev . 



Practice Session - 
Research Design 



. Independent Study - 
Data Analysis I 



Tuesday Section I-Prac.Sess.*- Small Group Session- 
August 29 Data Analysis I Data Analysis 1 



Independent Study - 
Data Analysis II 



Section Il-Small Grp. Practice Session - Independent Study - . 

Sess. -Research Design Data Analysis 1 Data Analysis II 



Wednesday Section I-Prac.Sess.- Small Group Session 
August 30 . Data Analysis II Data Analysis II 



Ind • Study-Proposal 
& Report Writing 



Section Il-Small Grp. Practice Session - 
Sees. -Data Anal. I Data Analysis II 



Ind .Study - Proposal 
& Report Wrltix^ 



Thursday Section I-Prac.Sess. Small Grp. Sess. -Prop. Social Event 

August 31 Prop.& Rept .Writing & Report Writing 



Section II-Sml.Grp. 
Sess. -Data Anal. II 



Prac.Sess.- Proposal Social Event 
& Report Writing 



Friday Section I-Final 

Sept. 1 Criterion Meas. 



Summary & Evaluation 
of Institute 



Section II-Sol.Grp. 
Sess. -Proposal & 
Report Writing 



Summary & Evaluation 
of Institute 



Participants may make travel departure schedules 
after 3:00 p.m. Friday. Transportation to Portland 
and Salem terminals will be provided. 
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Appendix B 

Dormitory Information 

Oregon College of Education 
Monmouth » Oregon 

1. Room payments for the two weeks ($42.00) must be PAID IN PULL - 
IN ADVANCE. (Note that this amount covers room only.) Please 
complete attached form and mall with your check. 

2. A late payment penalty of $1.00 per day, but not to exceed $5.00, 
will be assessed those not meeting payment schedules. 

3. Room reservation deposits should be mailed to the Director of 
Dormitories, Oregon College of Education. 

4. No refund of room charges will be made unless the Participant 
withdraws from the Institute. 

5. Participants will be housed in Arbuthnot Hall, located at the 
north end of the campus (see attached photo). On arrival, parti- 
cipants must sign a registration card with the attendant on duty, 
and must check out in like manner at termination of your dormitory 
occupancy. Men and women will be housed on separate floors. (No 
fraternization! ! !) 

6. At time of registration, a deposit of $1.00 must be made for your 
dorm room key. The amount will be refunded on return of the key 
at termination of your room occupancy. 

7. Sheets, p^lowcases, pillows, mattresses and pads, and a blanket 
will be provided, but you should arrange to bring along such items 
as study lamps, towels, clocks, bed spreads and other necessities 
for your individual requirements. 
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8. No cooking of any type will be allowed in dormitory rooms, other 
than in regular kitchen areas provided for this purpose. Therefore 
such items as coffee pots, soup makers, hot plates, griddles, corn 
poppers, or other cooking appliances, electric or other, will not 
be allowed In individual rooms. 

9. Dormitory reservations will be accepted for adults only. If you 
have any questions regarding your dormitory living, feel free to 
contact the Director of Dormitories at offices located in the 
Student Center building on the Oregon College of Educatloii campus 
(Fh. 838-1220, Eat. 311). 
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National Research Training Institute Participants 


Participant at Contract Eroense 


Summer Address* 


mss Mary Jo Buggs 

Wisconsin State Unlv. at Stevens Point 


802 Linwood Avenue 
Stevens Pointy Wisconsin 


Mr. John D. Jenks 

Wisconsin State Unlv. at LaCrosse 


2107 Main Street 
LaCrossey Wisconsin 


Mir. Patrick Monahan 

Wisconsin State Unlv. at Whitewater 


202 State Street 
Madlsony Wisconsin 


Dr. David M. Stoneoan 

Wisconsin State Unlv. at Whitewater 


1226 W. Kay Street 
Whitewater y Wisconsin 


Miss Veda Ponlkar 
Stout State University 


Room 14, Harvey Hall 
Stout State University 
Menomonie, Wisconsin 54751 


Dr. John A. Oostendorp 

Wisconsin State Unlv. at River Falls 


303 N. Dallas 

River Falls, Wisconsin 54022 


Hr. Francis T. Casey 
Marymount College 


1228 Providence Terrace 
McLean, Virginia 22101 


Sister Frances de Sales Boran 
Marymount College 


Marymount College 
Arlington, Virginia 


Dr. Robert H. O'Clalr 

Manhattanvllle College of the Sacred Heart 


240 W. Chester Avenue 
Port Chester, Mew York 


Mr. Frank Glaser 
Bennett College 


Bennett College 
Hillbrook, New York 


Mr. Richard Weldon 
Southern Oregon College 


Southern Oregon College 
Ashland , Oregon 97520 


Mr. David £. Terley 
Eastern Oregon College 


Eastern Oregon College 
LaGrande, Oregon 97850 


Miss Leona E. Todd 
Oregon College of Education 


Oregon College of Education 
Monmouth, Oregon 97361 


Mr. R. Allen Spanjer 
Portland State College 


Portland State College 
Portland, Oregon 97207 


Dr. Willlani J. Wade 
King College 


244 Edgewood Road 
Bristol, Tennessee 


Mr. H. M* Stanton 
Lane College 


Lane College 
Jackson, Tennessee 



* Best address available 
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Patrtlclpaat at Contract Expense 

Mrs. A. M. Miller 
Lane College 

Dr. Jacob Shapiro 

LeMoyne College 

Mr. H. Anderson 
LeMoyne College 



Sun«e r Address* 

Lane College 
Jackson, Tennessee 

377 Greenacres Road 
Memphis, Tennessee 38117 

Dept, of Psychology 
University of i^lsconsln 
Madison, Wisconsin 



Dr. Eugene Lee 
Emory University 

Dr. John Downes 
Emory University 

Mr. Phillip H. Coffman 
Jamestown College 



2967 Appling Way 
Cbamblee, Georgia 30005 

1995 Azalea Circle 
Decatur* Georgia 

Route 1 

Jamestown, North Dakota 



Mr. John A. Notheis 
Yankton College 



1017 Mulberry 
Yankton, South Dakota 



Miss Mary Catherine Aheam 1004 17th Avenue 

Mary College Menomlnle, Wisconsin 



Dr. F. 6. Shipman 1029 Akron Avenue 

North Carolina College at Durham Durham, North Carolina 



Dr. Norman C. Johnson 928 E. Lenoir Street 

North Carolina College at Durham Durham, North Carolina 

Dr. King V. Cheek 228 E. Lenoir Street 

Shaw University Raleigh, North Carolina 



Dr. Marlowe Shute 
Bennett College 

Dr. Lafayette Parker 
Winston-Salem College 

Dr. W. A. Gaines 

St. Augustine's College 

Dr. Donald Nasca 

SUNY, College at Brockport 

Dr. Naim A. Sefein 
SUNY, College at Fredonla 

Dr. Milton K. Erway 
Elmira College 



1115 Tuscaloosa Street 
Greensboro, North Carolina 

2016 Lincoln Avenue 
Winston-Salem, North Carolina 

1418 Oakwood Avenue 
Raleigh, North Carolina 

34 Lynnwood Drive 
Brockport, New York 

59 Cottage Street 
Fredonla, New York 14063 

418 Euclid Avenue 
Elmira, New York 



Dr. John J. Coffelt 

Oklahoma State Regents for Higher Education 



ERLC * Best address available 



Oklahoma State Regents for 
Higher Education 
Oklahoma City, Oklahoma 
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Participant at Contract Expense 
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Dr. Uilllam P. Cllpson 
Troy State College 


201 Highland Avenue 
Troy, Alabama 


Dr. Ralph Llghtsey 
Georgia Southern College 


P. 0. Box 731 
Statesboro, Georgia 


Dr. James Colmey 
Memphis State University 


4901 Roane Road 
Memphis, Tennessee 38117 


Dr. Jimmie C. Fortune 
Memphis State University 


4872 Leven 

Memphis, Tennessee 38118 


Mr. Levis W. Jones 
Fisk University 


Burrus Hall 
Fisk University 
Nashville, Tennessee 


Sr. Caroline Mary G.il?sen 
Mercy College of Detroit 


Mercy College of Detroit 
Detroit, Michigan 


Sr. Mary Joela 
Madonna College 


Madonna College 
Livonia, Michigan 


Mr. Wilbur Showalter 
University of Dayton 


University of Dayton 
Dayton, Ohio 


Mr. John M. Hamilton 
Antioch College 


Antioch College 
Yellow Springs, Ohio 


Dr. George Melville 
Knox College 


Knox College 
Galasburg, • Illinois 


Mr. James McAllister 
Monmouth College 


Monmouth College 
Monmouth, Illinois 


Miss Ruth Sproat 
Lake Forest College 


Lake Forest College 
Lake Forest, Illinois 


Dr. William J. Van Cleve 
St. John*s University 


St. John's University 
Collegevllle, Minnesota 


Mr. Richard Cole 
Luther College 


Luther College 
Decorah, Iowa 


Dr. Evan Lloyd 

Cleveland Commission oh Higher Education 


Cleveland Commission on 
Higher Education 
Cleveland, Ohio 


Dr. Donald Sweagon 
Baldwln-Wallace College 


Baldwin-Wallace College 
Berea, Ohio 
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* Best address available 



At Own or Institutional Expense 



Summer Address* 



Mr* Lee A* Burress, Jr* 

Wlscoxisln State Unlv* at Stevens Point 


208 Main Street 
Stevens Points Wisconsin 


Mr* Robert F* Beck 

Wisconsin State Univ* at River Falls 


Fanenat Mebraska 


Mr* Robert Albritton 
Oregon College of Education 


342 S* Monmouth 
Monmouth, Oregon 


Dr* Alice Knutb 

Oregon College of Education 


Oregon College of Education 
Monmouth, Oregon 


Mrs* Montana Rickards 
Oregon College of Education 


Oregon College of Education 
Monmouth, Oregon 


Mr* Marlon Rossi 

Oregon College of Education 


1220 S "D" Street 
Independence, Oregon 


Dr* Kenneth Walker 
Oregon College of Education 


346 Walnut Drive 
Monmouth, Oregon 


Dr* Lloyd O'Connor 
Eastern Oregon College 


Eastern Oregon College 
LaGrande, Oregon 


Dr* John McClain 
Clarion State College 


Clarion State College 
Clarion, Pennsylvania 


Mr* Ralph D* Schmid 
Emory University 


4190 Carrollwood Drive, Rt* 4 
Stone Mountain, Georgia 30083 


Zr, Dan Sillers 
j££;estown College 


Jamestown College 
Jamestown, Worth Dakota 


Miss Mary M* McLaughlin 
Mary College 


Mary College 
Bismarck, North Dakota 



*Best address available 
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Please complete this form and return It Immediately In the enclosed envelope. 
The informaticTT will be used to assist the staff In planning the Institute and 
preparing travel and stipend checks. 



Name 

A^ddress • 

(Street No. 

Social Security Number 



( ) Male ( ) Female 

(City) (State) (zip) 



1. In what area of emphasis (discipline) was your graduate training? 



2* Part of the training in the Institute will employ terminologies associated 
with psychology. Have you ever had a course in psychology? ( ) yes ( ) no 

3. Have you ever been Involved in a curriculum planning activity different from 
‘ that of preparing your own course syllabus? ( ) yes ( ) no 

4. Have you ever written a research proposal related to the improvement of 
instruction and submitted it for consideration to a funding agency? 

( ) yes ( ) no 

5. If yes to the last question, was it funded? ( ) yes ( ) no 

6. During the mid^weekend (August 26—27, for those interested, we are planning 
trips to the coast and to the mountains. Which would you prepare to visit? 

( ) coast ( ) mountains ( ) neither 

7. Two evening social events have been planned. Please indicate if you desire 
to attend. Spouses are invited. 

a. Steak barbecue, August 21, @ $3.00 each. ( ) yes ( ) no 

b. Chicken barbecue, August 31, @ $1.50 each ( ) yes ( ) no 
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8. The Institute will provide transportation to Monmouth for all participants 
arriving In Portland or Salem on August 20* To help us coordinate this 
transportation* please indicate (1) your mode of travel (plane* train* car); 
(2) your arrival place (Portland* Salem* Monmouth); and (3) your intended 
time of arrival: 

(1) Mode: (Please Include flight number) 



(2) Place: 



(3) Time: 



9« What lodging arrangements are you planning? ( ) Arbuthnot Hall 
( ) Hotel In Monmouth ( ) Other 
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Appendix C 
3rd Mailing 



Teaching Research Division 
OREGOM STATE SYSTEM OF 
HIGHER EDUCATION 
Monmouth • Oregon 



Dear 



According to the Information received you will be arriving 

In - ■ by ■ on 

at « If you are 

arriving In Portland at the airport on Sunday a receptionist 
will be there to greet you and inform you of transportation 
arrangements to Monmouth* The receptionist will be located in 
the main ticket lobby of the terminal building* 

The Dormitory check in time Is Sunday at * 

If you arrlce in Portland prior to Sunday you will be responsible 
for securing your own accomodations* Roomettes at the airport 
are available and transportation will be provided to Mbnmouth 
on Siuday* 

% 

If your plans of arrival have changed from those indicated 
above I please inform us so we can plan for your transportation 
to Monmouth* 



Slncerelyt 



Patrick R* Mahoney 
Administrator 



FRIhbjo 
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Appendix 0 
4th Hailing 
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Appendix D 



4th Mailing 

vsto DATE: July 31* 1967 

TO: National Research Training Institute Participants 

PROM: Patrick Mahoney* Administrator 
Teaching Research Division 

Our files indicate that you have not yet supplied us 
with your Social Security number as requested earlier this 
iaonth« If you desire to receive travel and stipend 
checks during the Institute* it is imperative for us 
to receive this information by August 4* 1967«. 

Thank you* 



PBM/da 



Appendix E 

Schediile for the Institute 
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Appendix E 

Schedule for the Institute 



(Self-study luaterlals will be Issued In orientation session) 



Sunday 
August 2G 



Monday 
August 21 



Tuesday . 
August 22 



Wednesday 
August 23 



Thursday 
August 2A 



Friday 
August 25 



Saturday 
August 26 

Sunday 
.August 27 



All participants to be paid stipends are expected to arrive on 
Sunday • Aug. 20* Registration and dormitory checkin 8 a«m« to 10 p»m« 

8:00 - 11:30 a<>m« liOO - 5:00 Pam* 7:00 - 10:00 PcU^ 



Section I-Orlentatlon 



Section II - 
Pre-Session Evaluation 

Section I - Practice 
Sesslon-Speclfyg Obj's 

Section II - Ind«Study- 
Speclfylng Objectives 

Section I-Prac* Sess«- 
Anal» & Instr. Spec's 

Section Il-Small Grp* 
Sess •-Specifying Obj's 

Section I-Frac« Session- 
Systems Development 

Section Il-Small Grp* 
Sess*- Anal«& In* Spec's 

Section I-Frac*Sess*- 
Measurement 

Section Il-Sml* Grp* Seas* 
Systems Development 



Independent Study - 
Specifying Objectives 

Orientation 



Small Group Session - 
Specifying Objectives 

Practice Session - 
Specifying Objectives 

Small Group Session - 
Anal* & Instr* Spec's 

Practice Session - 
Anal* 6 Instr* Spec's 

Small Grp* Session - 
Obj* Systems Devel* 

Prac* Sess-Ob jectlve 
Systems Development 

Small Grp* Session - 
Measurement 

Practice Session - 
Measurement 



Social Event 



Social Event 



Independent Study - 
Anal* & Instr* Spec's 

Independent Study - 
Anal* & Instr* Spec's 

Ind* Study-Ob j ectlve 
Systems Development 

Ind« Study-Objective 
Systems Development 

Ind* Study - Instr* 
Measurement 

Ind* Study - Instr* 
Measurement 

Independent Study - 
Research Design 

Independent Study - 
Research Design 



Trips to Pacific Coast or C^cade Mountains | as desired* 



Free Time* Individual arrangements* 
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8»00 - 11;3Q a>n,_ 


liOO - 5i00 T>*m. 


7j.00.ji.108.Q8.J..!Ba 


Monday 
August 28 


Section X«*Prac«Ses8*~ 
Research Design 


Small Group Session - 
Research Design 


Independent Study - 
Data Analysis X 




Section IX*Small Grp* 
Seas * -Measurement 


Practice Session • 
Research Design 


Independent Study - 
Data Analysis I 


Tuesday 
August 29 


Section X-Frac*Sess*- 
Data Analysis I 


Small Group Session- 
Data Analysis I 


Independent Study - 
Data Analysis II 




Section XX-Snall Grp* 
Seas* -Research Design 


Practice Session - 
Data Analysis X 


Independent Study - 
Data Analysis XI 


Wednesday 
August 30 


Section X-Prac*Sess*- 
Data Analysis IX 


Small Group Session 
Data Analysis XI 


Ind* Study-Proposal 
& Report Writing 




Section XX-Snall Grp* 
Sess*-Data Anal* X 


Practice Session - 
Data Analysis II 


Ind* Study-Proposal 
& Report Writing 


Thursday 
August 31 


Section I-Prac*Sess*- 
Prop* & Rep t*Wrl ting 


Small Grp *Ses3* -Prop* 
h Report Writing 


Social Event 




Section XX-Sml*6rp* 
Sess*-Data Anal* XI 


Prac *Sess * -Proposal 
& Report Writing 


Social Event 


Friday 
Sept* 1 


Section X-Final 
Criterion Meas* 


Summary & Evaluation 
of Institute 






Section II— Sml*Grp* 
Sess*-Proposal & 
Report Writing 


Summary & Evaluation 
of Institute 





Participants may make travel departure schedules 
after 3:00 p»m«. Friday* Transportation to Portland 
and Salem terminals will be provided* 
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I¥e- and Poet-Teete 
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I. 



Behavioral Objectives Test 



1. One way In Which a written behavioral objective for teaching nay differ 
from a non-behavloral objective Is that the behavioral objective always 
specifies : 

A. Teaching methods 

B. Teacher behavior 

C. Length of a teaching unit 

D. Criteria for measurement. 

2. An "objective,” as It has been defined for the purposes of writing 
-behavioral objectives, denotes: 

A. . A goal that a teacher Intends students to accomplish 

B. A desired goal for students to accomplish 

C. A goal for teachers to accomplish In their teaching methods 

D. A goal teachers would like to accomplish with their students 

3. Cenerally, the most valid indications of student behavior that are 
related to a behavioral objective are those Which: 

A. Beflect the objective Indirectly 

B. Foster democratic ideals 

C. Allow the student to express himself 

D. Are linked directly with the objective 

4. The following verbs might be used In writing behavioral objectives 
concerning the testing of geography. . Which verb would require the least 
clarification In a behavioral objective? 

A. Understand 

B. Draw 

C. Locate 

D. Identify 



5. The following verbs might be used In writing a behavioral objective 
for teaching high school English. Which verb would require the least 
clarification of a behavioral objective? 

A. Write 

B. Appreciate 

C. Illustrate 

D. Summarize 



6. In a behavioral objective, the audience Is: 

A. All the students In a particular grade or level 

B. Some of the students in a particular grade or level 

C. A group of students who are expected to reach the criterion in 
the behavioral objective 

Do A group of si^udents who behaved as the objective indicates 

7. The "conditions" of a behavioral objective specify 

A. The setting In which the students* behavior is to occur 

B. The actions which the teacher will observe 

C. The actions of the leader 

D. Criteria for measuring the student behavior 



8. The "behavioral" aspect of a behavioral objective specifies: 

A. Teacher behavior 

B. Pupil behavior 

C. Behavioral conditions 

D. Measurement of behavior 
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II. 



From each o£ the following groups of objectives select the one objective 
which is most nearly stated in behavioral terms. 



9. 



A. 

B. 

C. 

D. 



10. A. 



B. 

C. 



D. 



11. A. 
B. 
€♦ 
D. 



12. A. 

B. 

C. 

D. 



13. A. 

B. 

C. 



D. 



To teach the students how to build a 3 x 5 inch jewel box... 

Tlie student will learn the principles of constructing small boxes... 
Each 10th grade shop student will build a 3 z 5 inch jewel box... 

To show 10th grade students the proper way to construct a 
3x5 inch box. . . 



To remember t^ie names of the ten provinces of Canada in such a 
way as to... 

To learn and remember the names of the ten provinces of Canada... 

To name and label the ten provinces of Canada on a blank map showing 
only ... 

To apprec^jite the Importance of the ten provinces of Canada. . . 



To learn che names of the different latitudes of... 

To write on an outline map the names of the different latitudes of... 
To know the names of the different latitudes of... 

To remeadier how to identify the different latitudes of... 



To teach the fundamentals of diagraming electrical circuits... 
To learn the fundamentals of diagraming electrical circuits... 
To diagram an electric circuit with all the fundamentals . . . 

To know how to diagram an electrical circuit. 



To define the terms decagon* geometry* and equilateral... 

To learn the terms decagon* geometry and equilateral... 

To know the concepts decagon* geometry and equilateral... 

To understand the terms decagon* geometry and equilateral... 



14. A. 

B. 

C. 

D. 



To explore the identification of various types of vegetation... 
To name and describe in writing ten types of vegeation. . . 

To learn the names of ten different types of vegetation... 

To know the names of ten different types of vegetation. . . 



15. A. 

B. 

C. 

D. 



To point out five essential points on a map... 

To learn about five essential points on a map... 

To know and \inderstand five essential points on a map... 

To appreciate the value of knowing five essential points on a map... 
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III. 



From each of the following groups of behavioral objectives select the one 
that most accurately describes the desired behaviors . 

16. A. . Locate ten major oceans, bays and straits on an outline nap. 

B. Identify ten major oceans, bays and straits on an outline map. 

C. Write the names of ten major oceans, bays and straits on an 
outline map. 

D. Be able to recognise ten major oceans, bays and straits on an 
outline map. 

17. A. To send a. four-word message by Morse code with a blink light. 

B. To send a Morse code message. 

C. To send a message with a bllidc light. 

D. To send a message using a code. 

18. A. Must be able to read Spanish writing. 

B. Must translate Spanish Into English verbally. 

C. Must read a Spanish paragraph and translate orally Into English. 

D. Ihist be able to tell the differences between languages. 

19. A. Must write a Campbell style library paper of at least ten pages. 

B. Must show an ability to write a library paper. 

C. Must write a Campbell style library paper and finish It. 

D. Must be able to write a paper of ten pages or more. 

20. A. Must give 4 examples of methods used to teach biology. 

B. Must write eaum^les of 4 basic Instructional techniques In biology. 

C. Must demumstrate an ability to teach biology 4 different w^s. 

D. Must show 4 examples of how to teach biology. 

21. A. Find the ten largest cities in Canada. 

Bo Locate the position of each of the ten largest cities In Canada. . 

C. Write a list containing the ten largest cities In Canada In ordeir 
of size. 

D. Recognize the rank of each of the ten largest cities In Canada. 

22. A. Write on an Isothermal map with a red pencil accurately. 

B. Find the three spots on an Isothermal map with heaviest rainfall. 

C. Mark with a red. pencil the 3 areas on an Isothermal m«p with 
heaviest ralnfsdl. 

D. Locate and recognize areas of heavy rainfall on an isothermal map. 
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Proai.tach of the following groups of statenents select the one which most 
clearly specifies an acceptable level of performance* 



23. A. To write a topic sentence suitable for three given related sentences. 

B. To write a good topic sentence without error. 

C. To write accurately a topic sentence in 3 minutes. 

D. To write i\ sentence for any topic. 

24 < A. To obtain a score of 50% on a final test for the course. 

B. Ge'^. s score of SO or more on a 100 item final. 

C. Score better than at least half the class on the final test in 
this course. 

I), tbist be able to answer correctly at least 50Z of the items on a 
100 question true-fals<?> test* 

25. A. Write the names of the Canadian provinces on an outline map. 

B. Write the ten provinces on an outline nap provided in class. 

C. Write the names of at least 7 of the 10 Canadian provinces in a 
5 minute period. 

0, In five minutes write the names of ten provinces on a Canadian map. 

26. A. To underline verbs in sentences accurately. 

B. To locate and underline verbs in sentences correctly. 

C. To underline all verbs in 10 sentences in 15 minutes with 2 or 
fewer errors. 

0. To write all verbs from 10 sentences on a separate sheet of paper. 

27., A. By labeling a given outline map o*: waterways correctly within 
h hour. 

B. By being able to look at an outline map and locate waterways correctly* 

C. By placing waterways on an outline map accurately. 

D. By labeling without error all the waterways on an outline map in 
30 minutes. 

28. A. Must compute accurately to 1 decimal place at least 20 of 30 

glv«n division problems. 

B. Must work out long division problems in such a way as to demonstrate 
ability. 

C. Ihist finish accurately an assignment calling for solution of 
long division. 

D. Must be able to work 20 long division problems in 30 minutes. 

29. A. Must be able to keep time to a given record of music. 

B. ^hlst clap hands in 4/4 rhythm through ten bars of **Ten Little Indians.*' 

C. Mist correctly clap in 4/4 rhythm, 4 counts in each measure, to 

a recording of "Ten Little Indians." 

D. Must be able to demonstrate the ability to keep time to a given record. 









From each of the following groups of statements select those which describe 
a condition under which an objective is to be measured. 

30. A. Must he able to identify cones, cylinders, and prisms. 

B. Given a set of geometric shapes 

G. Within a period of 30 minutes with less than 3 errors 
D. Students In a 10th grade Geometry class 

31. A. Without the aid of references 

B. 33 correct out of a possible 50 

C. 9th grade geography students 

0. Select the proper location of major rivers. 

32. A. Compute the area of a circle. 

B. Without the aid of a slide rule. 

C. Following the proper formulas. 

D. 9th grade algebra students. 

33. A. Given a problem of the following class. 

B. Select the correct answer in 60X of the class. 

C. Be able to answer correctly 

D. The entire 12 grade calculus group 

34. A. In a period of less than 1 hour 

B. Without the aid of a reference map 

C. Find the location of a major continent 

D. Correctly in 40Z of all cases 

35. A. By arranging parallel lines on a given map 

B. The student will Identify and label 

C. Three of the basic map projections 

D. Will spell all three correctly in a period of 5 minutes 

36. A. The student will solve an algebraic equation 

B. Given a linear equation with one unknown 

C. Within a period of 4G minutes 

D. And follow the correct procedures 
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VI. 



Each of the following statements is a part of a behavioral objective. For 
each stateoient select the answer Which best describes nhat the statement 
refers to in the objective. 



37 . . .within a period of 20 minutes • • • 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 



38. ..the first year college geography class... 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 



39. ..given a set of carpenters tools. •• 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 



40. ..without the use of references... 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 



41. ..all auto repair men iu electrical circuiting will... 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 






'3 



42. ..locate and label... 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 



I 



43. ..with a slide projector and slides... 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 



44. ..identify the areas containing salt, phosphorous and... 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 
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VII, 



The following behavioral objectives are followed by a list of the four 
basic requirements necessary for a well stated objective. Select that 
requirement which you feel is least adequately met, or has been omitted 
altogether. 

45. The sixth grade social studies student, given a slate outline map, 
will write the names of continents on It. 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 

46. Given roughly circular shapes with various arrows indicating direction 
the student shall select without error in a 5 minute period all those 
whose arrows Indicate a clockwise rotation. 

A. Audience 

B. Bdiavlor 

C. Condition 

D. Degree 

47. The ninth grade social studies student will locate and name at least 
4 of the 5 climatic areas of Canada. 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 

48. By the end of two months they should be able to type 20 words per 
minute for a period of five minutes with Ic^s than three errors. 

A. Audience 

B. Behavior 

C. Condition 

D. Degree 

49. On an outline map provided, ninth grade geography students will Identify 
and label the major rivers of the U.S. and Canada. 

A. Audience 

B . Behavior 

C. Condition 

D. Degree 
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VIII. 



In the most of the following statements of behavioral objectives one or more 
parts have been worded badly or left out completely. For each one select 
the part or parts you think are inadequate and mark the appropriate responseCs). 

50. The student should know the names of three mathematicians and contribu- 
tion of each to geometry. 

A. Audience 

B. Behavior 

C. Conditions 

B. Degree 

S. All of these 
F. None of these 

51. Each student will write a topic r‘*ntence suitable for three given 
related sentences . 

A. Audience 

B. Behavior 

C. Conditions 

D. Degree 

E. All of these 

F. None of these 

52. The student will identify at least three key steps in the proof of 
**The square root of two is an ir rationed number.*' 

A. Audience 

B. Behavior 

C. Conditions 

D. Degree 

E. All of these 

F. None of these 

53. Given a subject which is consistently classified under the same number* 
to tell from the card catalog where to look for books in that subject. 

(Give call number as far as it consistently occurs.) 

A. Audience 

B. Behavior 

C. Conditions 

D. Degree 

E. All of these 

F. None of these 

54. Students show perception of tonal relationships within a scale (major 
or minor) by singing with syllables or numbers* a familiar song at a tempo 
established by the teacher. 

A. Audience 

B . Behavior 

C. Conditions 

D. Degree 

E. All of these 

F. None of these 
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55. Givea twenty notes written on a staff on the board vlth the bass clef, the 
class must write down the names of these notes in one minute, as Indicated 

by teacher's start and finish signals, based on teacher's stop watch. 

A. Audience 

B. Behavior 

C. Conditions 

B. Degree 

E. All of these 

F. None of these 

56. Given the titles of five books, to locate the names of the authors in the 
card catalog and write down the authors and titles in acceptable biblio- 
graphical form. 

A. Audience 

B. Behavior 

C. Conditions 

D. Degree 

E. All of these 

F. None of these 

57. Each student will give the root meaning of the terms "geometry," 
"quadrilateral," "decagon," "circumference," and "inscribed." 

A. Audience 

B. Behavior 

C. Conditions 

D. Degree 

E. All of these 

F. None of these 

58. The studen\t will identify all basic shapes (cylinder, cone, prism, cube, 
and sphere) used In familiar buildings and structures. 

A. Audience 

B. Behavior 

C. Conditions 

D. Degree 

E. All of these 

F. None of these 

59. Spell correctly the following words after a 20 minute oral study period: 

cat, dog, bull, white, store. This will be a written eitmn which will last 
S minutes. 

A. Audience 

B. Behavior 

C. Conditions 

D. Degree 

E. All of these 
None of these 

60. At the end of the two week library session, the pupils will locate, by 
the use of the card catalog, five books named by the Instructor. A niflif<innn> 
time of five minutes will be allowed. 

A. Audience 

B . Behavior 

C. Condition. 

D. Degree 

E. All of these 

F. None of these 
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Objective Analysis 
Criterion Test 






1. Whicli of these is a benefit of pre-design in contrast to 
ext^x’.poraneous design? 

a) early planning is diminished. 

b) restoration of the proper emphasis o- teacher 
functions is facilitated. 

c) student study tasks are more closely monitored. 



2. A programed instructional booklet exemplifies. 

a) a superficial choice of terminal objectives. 

b) Intentional extemporaneous design of the conditions 
of learning. 

c) pre-design of the conditions of learning. 

d) a wide range of enabling objectives. 



3. Pre-design of instruction is a waste of tine. 

a) agree 

b) neutral 

c) disagree 



4* Since we do not know enough about the learning process, it is 
Impossible to pre-design instruction to make it more effective. 

a) agree 

b) neutral 

c) disagree 



5. The best use of an instructor's time is to know his subject 
matter thoroughly rather than to worry about how to teach it. 

a) agree 

b) neutral 

c) disagree 
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6« A student is cheated if he goes to a class xjhen instruction 
Is not pre-deaigned. 

a) agree 

b) neutral 

c) disagree 



7« Pre-design is a poor substitute for exteaporaneous design* 

a) agree 

b) neutral 

c) disagree 



8* Prefdeslgn will do alot to improve instruction* 

a) agree 

d) neutral 
c) disagree 



9« If I had my way, all instruction would be pre-designed* 

a) agree 

b) neutral 

c) disagree 



10* In many subjects, extemporaneous design is all right, 

a) agree 

b) neutral ^ 

c) disagree I 

■S 




11. An objective analyses may produce a "good” hierarchy or a ”not- 
so-good” hierarchy* In the long run, a ”good” hierarchy is 
one that 

a) has many levels correctly positioned* 

b) includes enabling objectives that are easily accom- 
plished by learners* 

c) help the instructor in determining what to teach, and 
in what sequence to teach it* 
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12. IThich of these terms does not describe ‘‘enabling objectives*’? 

a) Basic factual and conceptual knowledge. 

b) Component behavior or skills. 

c) Lower order competencies. 

d) Format of the Instruction. 



13. After identifying the enabling objectives the next step is to: 

a) Identify the type of learning Involved in each 
objective. 

b) Develop an instructional environment ^ich will 
transform learners into graduates who can perform 
at the specified level. 

c) Design Instructional sequences that reflect the 
basic learning principles. 



lA. After establishing the terminal objective (s) the designer 
should ask the following question. 

a) What level on the hierarchy of learning is this 
objective? 

b) VIhat media will best facilitate reaching this goal 
without losing the individualized approach? 

c) What would the student have to know to perform this 
objective successfully? 

d) What in the \7orld do I do now? 



15. Below is a set of objectives. Tvro of these are enabling 
objectives. One is a terminal objective. 

1) Represent forces and their directions as parts 

of triangles. 

2) Name parts of a triangle. 

3) Name horizontal and vertical components of forces 
as vectors. Vlhich is a terminal objective? 

a) 1 

b) 2 

c) 3 
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16. Below is a set of objectives. One is a terminal objective 
and the others are enabling objectives. 

1) The student will make a left turn with a stan- 
dard shift car onto a highway from a stop. 

2) The student will discriminate the clutch from 
the gas pedal and the brake. 

3) The student will disengage the clutch. 

4) The student will signal for a left turn. Vhich 
of the following is a terminal objective for this 
set? 

a) 1 

b) 2 

c) 3 

d) 4 



17. In the following objective analysis, choose the correct 
ordering of enabling objectives. 




r 



IVa 



1 . 

2 . 



I- 



4. 

5. 




Distinguish between equal 
and unequal expressions. 
Perform operations of 
multiplication and division 
Recognize false math 
sentences 

Recognize the math sentences 
Recognize true math 
sentences 



a. b. c. d. 



Ila - 1 2 5 3 

lib - 4 1 3 5 

III - 2 4 2 4 

IVa - 5 3 4 1 

IVb - 3 5 1 2 
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18. Read the following list of objectives for a math problem. 

1) Read 1 and 2 place numerals. 

2) Tlultioly a two place whole number by a one place 
xiThole number . 

3) Multiply a one place whole number by another one 
place whole number. 

4) Add a group of ten (s) to a two place whole number 
(carrying) . 

TMch diagram is closest to revealing the hierarchy? (The numbers 
In the squares refer to the numbered objectives above.) 





Instructional Systeta Development Test 

Name 

Por test Items 1-8, circle the answer you consider best; 
then push the same letter button on your response station. 

1. The stages defined In the Instructional system develop- 
ment section are: 

A. Identify behavioral objectives; determine enabling 
objectives, produce the Instructional product; 
analyze tr^’out results. 

B. Produce Instructional product; conduct tryout of 
product; analyze tryout results; modify product; 
recycle. 

C. Determine enabling objectives; produce instructional 
product; construct performance measures; conduct 
tryout; analyze results; recycle. 

D. Produce Instructional product; construct performance 

measures; conduct try-out; analyze results; recycle. 

2. The process of systematically following the instructional 
"blue prints" or specif lea tl6ns Is to: 

A. Produce the Instructional product 

B. Identify types of learning 

C. Identify behavioral objectives 

D. Conduct try out of the product 

3. To translate the analysis of try-out results into changes In 
the Instructional materials is to; 

A. Determine enabling objectives 
?. Produce the instructional product 

C. Recycle the development process 

D. Modify the product 

A. Obtaining data from observations and other evaluations of 
the system such that weaknesses can be identified is to: 

A. Construct performance measures 

B. Determine enabling objectives 

C. Conduct try-out of the product 

D. Analyze try-out results 



The stage of Instructional system development vhose purpose 
is to detenaine whether the Instructional system achieves 
its objective is the: 

A. Analysis of try-out results 

B. Identification of events that provide conditions of 
learning 

C. Detemlnatlcn of enabling objectives 

D. Production of the Instructional product 

Recycling is concerned vrith 

A. Determining enabling objectives for all behavioral 
objectives 

B. Administering and analyzing performance measures 

C. Modifying all phases of the Instructional product 

D» Reduplicating all instructional system development 
stages 

The team of specialists considered essential to produce the 
instructional product Includes a? 

A-. Content specialist, media specialist, behavioral 
scientist 

B. Production specialist, measurement specialist, field 
monitor 

C. Subject matter specialist, field monitor, liaison 

D. Production specialist, try out specialist, measurement 
specialist 

The continuum of experience model is most useful in 

A. Constructing performance measures 

B. Interpreting results of the try-out 
C* Deciding what media to use 

D, Deciding how to conduct the try-out 

For test items 9-16, circle whether the statement is true 
false and push the same letter button on your response station* 

Try-out of the Instructional product occurs after all develop- 
ment has been completed* 

A. True 
B* False 
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10. Try-out of the instructional product should only be conducted 
with learners of appropriate prade and ability level. 

A. True 
6. False 

11. Analysis of try-out results cannot put more confidence in 
test results than In conoaents from try-out subjects. 

A. True 

B. False 

12. Flgh error rates on a criterion test indicate the instruc- 
lonal system has portions that are relatively Ineffective. 

A. True 

B. False 

13. Try out following Instructional system modification is 
crucial. 

A. True 

B. False 

14. If it Is possible, the same subject should be used to try- 
out all revisions of a particular segment of the new in- 
structional system. 

A. True 

B. False 

15. Product development requires translating instructional 
specifications into tjrritten statements and/or media forms. 

A. True 

B. False 

16. Incidental details having little to do \rLth the basic 
content of the new Instructional system often interfer with 
effective learning during the try-out. 

A. True 

B. False 
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For teat items 17 - 23, circle the answer you consider best; 
when all persons have completed these items you will be in- 
structed to push the appropriate button on your response station. 

17. Analysis of try-outs is used to; 

A. Plan modifications to the system 

B. Determine weak teaching strategies 

C. Determine unrealistic specifications 

D. All of these 

E. Mone of these 

18. To measure the first try-out of a segment of a new instruc- 
tional system 

A. requires a validated test 

B. Demands small groups 

C. Involves only learners 

D. All of these 

E. None of these 

19. Modifications to the new instructional system following 
analysis are planned with: 

A* The same team of specialists used in production 

B. A new team of specialists 

C. The content specialist only 

D. All of these 

E. None of these 

20. The process of producing the Instructional product in- 
volves 

A. Systematically following the instructional specifi- 
cations 

B* Translating specifications into prototype 

C. liaison between a team of specialists 

D. All of these 

E. None of these 
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21. To modify the instructional materials following try-out 
requires 

A. Translating the analysis results into changes 
in the product 

B. Planning with the development specialist team 

C. Revising enabling objectives 
0. All of these 

E. I^one of these 

22. In teaching learners to discriminate between sounds 
produced from an oboe and an English horn, according to 
the continuum of experience model, use 

A. Direct experience 

B« Objective codification (audio) 

C. Subjective codification (audio) 

D. All of these 

B. None of these 

23* Results of an analysis of the total instructional system 
indicates that learners achieved all the stated enabling 
objectives but did not achieve the terminal objective. 
Which interpretation would be appropriate , 

A. Enabling objectives were irrelevant to the terminal 
objective 

B. Enabling objective stated required learning steps 
that were too big. 

C. Enabling objectives were too easy 

D. All of these 

E. None of these 



24. During the first session in the Institute on Specifying 
BehevloraX Objectives you \rrote two objectives in the 
ares of your discipline. For this part of the test, 
copy one of those objectives in the space below and do the 
following: ^irst, identify one enabling objective 

necessary to attain the terwinal behavior you stated. 

Then: 

A. Describe how you would proceed to produce the in- 
structional segnent for that enabling objective. 

B. Detail how you would plan to try-out the segment 
duced. In your discussion give consideration to all 
pertinent aspects of production and try-out covered 
in this section. 



25. The section that folloTTs contains a series of frames taken 

from a self-instructional program designed to teach 6th grade 
students concepts and principles of latitude and longitude. 
Below the frames is a summary of the error rates for each 
frame resulting from a tryout of the materials with low, 
average and high ability students dratm from the 5th, 6th 
and 7th grades. After studying these materials, 

A. Judge which frames were bad for which students. 

(Consider acceptable frames as those not exceeding 
an average error rate of 14.) 

B. Write a brief statement (approximately 100 words), 
based on the evidence available. Indicating what 
you think caused the frames to be faulty. 

C. Briefly describe the steps you would take next to 
modify the fault^r frames. 
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8-30 Look at Figure 10. The longitude of Point A 
Is writte n (:) 

8-31 The longitude of Point B on Figure 10, Is 
writte n (?) 

8-32 The longitude of Point C on Figure 10 is 
written (?) 

8-33 Longitude is (?) - (?) distance or 
location. 

8-34 Longitude lines are numbered from 0 at the 
(?) meridian to (?) ^ « 
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8-35 On Figure ii ve have an imaginary map with 
with imaginary cities. See if you can read 
their longitudes. Use Figure 11 for the rest 
of this set. The longitude of Conlin is 

8-36 The longitude of Elten i s (?) ^ (?_)__* (?) « 

8-37 The longitude of Dagman i s (?)^^ (?) J (2)_ . 

8-38 The longitude of Frantln is, C?) . 

8-39 The longitude of Baatle is ( 7) 
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1®15*E 

1®15’W 
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Error Rates Per Frame by Grade and Ability Level 

5556667 77 



Frame 

Nusd>er 


CO 

as 


Ave* 

N-16 


High 

N-18 


Low 

N»9 


Ave. 

N«19 


Hl^i 

N»20 


Low 

N-12 


Ave. 

N»14 


High 

N»5 


8-30 


22 


0 


6 


11 


5 


0 


0 


0 


0 


8-31 


6 


6 


6 


11 


0 


0 


0 


0 


0 


8-32 


22 


6 


0 


0 


n 


5 


0 


7 


0 


8-33 


22 


13 


0 


11 


11 


0 


0 


7 


0 


8-34 


17 


19 


6 


11 


11 


0 
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0 


0 


8-35 


33 


50 


28 


44 


26 


5 


17 


7 


0 


8-36 


39 


38 


28 


44 


26 


10 


25 


21 


0 


8-37 
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11 


22 
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17 
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8-39 


33 


19 


11 


44 


42 
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8 
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0 










A. Identify those frames judged bad and for which students 



Bad Frames 



T'lhlch Students 



B. fJhat caused frames to be faulty? 
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C. T-lhat next step ^ would you take to modify faulty frames? 




Test Over Heasurement 



Part I. Foundations 

Items appearing in Part I of the test are designed to assess knowledge 
that is basic to the use of measurement in instructional ^sterns development and 
research* In responding to these items place a T in front of the items which . 
are true and an F in front of those which are false* 

1, Instructional research and instructional evaluation refer to essen- 
tially the same process* 

.2* Demonstrating the effectiveness of an instructional system in one 
school setting does not mean that it wiU be effective in another. 

3* The aim of instructional evaluation is to determine whether a par- 
ticular instructional system brings about the educational outcomes 
(behavioral objectives) that are intended to derive from it* 

4* Persons interested in instructional systems evaluation must become or 
must rely heavily upon a person competent in measurement in the 
behavioral sciences* 

5* Because of the ^inexactness” of measurement in education and the 
behavioral sciences two or more measures should be used to assess 
any characteristic or outcome that is being considered in a particul£a* 
study. 

6. The concepts of reliability and validity enter educational measurement 
only because constant error appears in all such measures* 

7* The concepts of the relevance, representativeness and fidelity of 
items in a measure have as much to do with the problem of constant 
error as does the concept of ”construct” validity* 

0. The control of ”random” error in measurement is one of the most 
bothersome and difficult problems that educators face in carrying 
out instructional research and evaluation* 



■ , 9* The essential difference between measurement in the physical sciences 

and the beloa^/ioral sciences lies in the fact that pl-^sical sciences 
rely upon direct measurement, i.e. measurement of observable proper- 
ties, uhile the behavioral sciences rely upon indirect measurement, 
i«ei, measurement of "indicants" of inferred properties. 

10. The accuracy of a measure is Anonymous with its reliability. 

Part II, Applications 

Items appearih(j in Part II of the test are designed to assess the ability 
to apply basic knowledge about measurement to the solution of tasks demanding of 
that knowledge. In responding to the fir-st item identify the elements (proper- 
ties, traits, characteristics, outcomes) that can be measured only indirectly, 
i.e,, that are hypothetical constructs . Do tliis by placing a check in front of 
these eleraents. 

Ability to solve ators;^ problems in math©natics 

Knowledge of ancient liistory 

Personality 

Intelligence 

Anxiety 

Time required to run the hundred yard dash 
Considerateness 

Orientation to the use of questions 
Citzenship 
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In responding to the second item in part II of the test indicate the 
level(s) of measurement (column 2) that are appropriate and feasible vrithin_a _ 
school sett'^pg for the measurement of the cognitive outcomes listed in column 
!• Do this by placing the number descriptive of the level(s) of measur«nent 
in front of the cognitive outcome that is to be measured* Where more than one 
level is appropriate rynk them according to the power of the data tha **** 
oome from each* listing the most powerful first* 



Rules governing basketball 

History of the Eskimo 

Sensitivity to the feelings 
of others 

Competence in math 

Competence in marbles 

Use of good table manners 

Reading skill 

Writing skill 

"elf confidence 

Tolerance of individual 
differences 



1* Knowledge level 

2* Situational response 
level 1: Described 

criterion behavior 

3* Situational response 
level 2: Related 
criterion behavior 

4* Situational response 
level 3 s Isomoi*phic 
criterion behavior 



Part III, liMtrument Development 

Items appearing in Part III of the test are designed to assess knowledge 
that is required in order to develop instruments for use in educational measure- 
ment, In responding to the first item, match the various attributes of a 
measure that are listed in column 1 with the phrase in column 2 that most appro- 
priately describes the kind of evidence required in support of that attribute* 



Relevance 
Representativeness 
FideUty 
Reliability 
Construct validity 



1, Theoretical clarity of items 

2* Conceptually appropriateness of 
items 

3* An individual's scores on a 
test taken twice with two weeks 
intervening 

4* An individual's scores on 
alternate forms of a test 

5* The correlation between an 

individual's performance on two 
measures that are known to be 
related 

6, The extent to which an item 
differentiates between those 
scoring hi^ and low on a test 

7* The extent to which an item 
calls for behavior that is 
isomorphic to the property that 
is being measured 



/ 
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In responding to the second item in this part of the test indicate the 
class(es) of measurement (column 2) that are appropriate and feasible within a 
school setting for the measurement of the cognitive outcomes listed in column 1« 

i 

Do this hy placing the number descriptive of the class (es) of measurement in 
front of the cognitive outcome to be measured* Where more than one class is 
appropriate rank them accordinfl; to the power of the data that would come from 
each, listing the most powerful first* 



Rules governing basketball 

, History of the Eskimo 

Sensitivity to the feelings 
of others 

Competence in math 

Competence in marbles 

. Use of good table manners 

Reading skill 

. Writing skill 

. Self confidence 

Tolerance of individual 
differences 



Interview 

Systematic observation 

Standardised objective measures 
(Paper and Pencil) 

Standardised projective measures 
(Paper and Pencil) 

Teacher-made tests (Paper and 
Pencil) 

Unobtrusively obtained products 
and/or records 

Unobtrusive observation 



1 . 

2 * 

3 . 

4 . 

5 . 
6 * 
7 . 
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Directions: Read the proposal extract and answer the questions 
that follow* 

III. Oblectl’ves 

Ihe primary objective of the proposed research Is to determine 
whether or not student attitudes towards teaching objectives in- 
cluded In teacher education programs are effectively altered after 
they have had experience In simulated settings. The experimentation 
will be designed to answer questions which are specific to the 
particular experiences Included In the materials. The simulation 
problems are. In this case, limited to situations of a personal- 
social nature. 

Specific questions be answered are the following: 

1. Will the experiences provided throu^ Individualized 
instruction in the simulation facility (as described by Kersh, 1963) » 
produce changes in attitude in a positive direction toward the 
subject matter of educational psychology? 

t 

2« Will <dianges in attitude become evident after the learner 
has had experience with one program of 20 problem sequences? 

3. Will changes in student attitude maintain In strength 
following the termination of the learner’s e^qperlence In the 
simulated setting? 

IV. Procedure 



I 



1 ) 



A. General Miethod and Research Strategy 



1. Sample Plan and Procedure. The experimental subjects 
will be selected from the students at Oregon College of Education 
majoring in elementary education. They will complete their in- | 

structlon in the classroom simulator within one academic year of 
their practice-teaching experience or internship. The subjects 
will be screened on the basis of previous educational background 
aiiid experience to insure homogeneity in this regard. Also, they 
will be screened on the basis of their performance on the pretest i 

of attitude toward specific teaching objectives selected from those \ 

included in education courses. In so far as possible, only those j 

students whose performance on the pretest indicates that they are I 

neutral or negative toward the specific teaching objectives will be | 

included. Subsequently, the subjects will be assigned to either 
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the experimental or the control group randomly on the basis of 
sdiolastlc aptitude, sex, and other selected variables which other- 
wise mlg^t bias the findings* 

2* Treatments* The classroom sinulatioa tedinique under con- 
sideration attempts to create for the student teacher all of the 
relevant features of a single classroom situation* 

In brief, the instructional procedure which has been developed 
for experimentation with the simulation materials is as follows: 
First the student teacher (T) is oriented to the simulation facility 
and to the procedure, then he is given a performance test in the 
simulated classroom using one of the three programs* The orienta- 
tion and pretesting procedure takes approximately one and one-half 
hours per subject* Next, T is given the actual instruction in the 
simulation facility* The filmed problem sequences of actual class- 
room situations are presented and T is requested to enact his res- 
ponse to each* Depending upon the reaction of T, the experimenter 
(E) selects and projects one of two or three alternative feedbadc 
sequences* 

3* Controls* The control group will be treated in every 
respect the same as the experimental group except the individuals 
in the control group will not experience instruction in the sim- 
ulated setting* Differences in attitude between the experimental 
and control groups may be attributed only to experience in the 
simulation facility* 

B* Data l^pes to be Gathered and Methods to be Used* 

As is indicated above, the experimental group will undergo 
experience in the simulation facility which may be conveniently 
interrupted at three points: (1) at the end of the pretest period 

which includes the first 20 problem sequences; (2) after the in- 
structional period, and, (3) after the post-test which terminates 
the experience in the classroom simulation facility* Criterion 
tests will be administered to individuals in the experimental group 
before their experience in the simulation facility begins, and after 
each of the instructional phases indicated above* Approximately 
six weeks after termination of tdie simulation experience, the 
criterion test will be administered once again* Individuals in 
the control group, which will not have experience in the simulation 
facility, will be tested on a time schedule approximating that of 
individuals in the experimental group* 
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QUESTIONS: 

1; Nhat is the experimental unit? 

2* Nhat la /are the experimental treatmentCs)? 

3* What la the method of asaignment? 

4* Diagram the deaign using R*a» X'a, and 0*8* 

5« Hat aourcea of invalidity that are accounted for* 



6* list sources of Invalidity that are not accounted for* 



7* Bedeslgn the proposal^ give both new diagram and brief 
explanation* 









Bata Analysis I 
Criterion Examination 



1. Assume that the numbers 6, 13, 24 were taken from a ratio 
scale, ^ch of the following sets of numbers would be 
appropriate substitution? 

a. 13, 20, 31 

b. 24, 52, 96 

c. U, 25, 47 

d. 1, 6, 14 

2. If the nuodbers 4, 17, 43 were taken from an ordinal scale, 
which of the following sets would be an appropriate substi- 
tution? 

a. 1, 2, 3 

b. 4, 16, 12 

c. 13, 10, 26 

d. none are appropriate 

. If the numbers 6, 21, 24 represent an Interval scale which 
set of numibers would be an appropriate substitution? 

a. U, 40, 45 

b. 12, 42, 48 

c. 18, 63, 72 

d. 21, 35, 39 

For each of the following kinds of measures indicate whether the 
scale is nominal, ordinal, interval, and ratio 

4. Human age In years. — 

5. IQ 

6. numbers on pages In a book — 

7. Notes on the musical scale — 

8. Tesq>erature on a centigrade scale 

9. Elapsed time in seconds — 

10. Calendar years ■ ■ ' — 
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II. An investigator wished to determine whether physical coordi- 
natilon training was effective in iaprovlng reading 
effectiveness. He selected a sample of **below grade place- 
nest** readers gave 20 hours of training in lateral 
coordination. A second sample was chosen from the sane pool 
of low readers and given no training. For analysis purposes 
he should consider the samples 

a. independent 

b. related 

12. A second Investigator studying the same problem selected only 
one group of low readers and gave them training. He then 
compared pretraining and post-training reading performance. 
His samples should be considered 



13. A third investigator thought that differences in training 
effectiveness might be expected for boys and girls. He 
designed his study to have training and no training groups of 
boys and girls. How many samples would be required for 
analysis purposes? 



14. The null hypothesis idiich states that "the differences 
between means and variances of samples are no greater than 
differences due to the vagaries of random sampling from a 
single, normally distributed, infinite population,*' is best 
suited for 

a. causal-comparative studies 

b. experimental studies 

c* exploratory studies 

d. studies of physical characteristics only. 

15. Causal-comparative studies differ from experimental studies 
in that 

a. Causal-comparative studies look for differences while 
experimental studies only look for change. 

b. Causal-conparative studies attend to differences in 
means and variances while experimental studies attend 
only to differences in means. 

c. Causal-comparative studies seek explanations on the 
basis of some characteristic of subjects, idille 
experimental studies seek to determine effects of an 
additional influence. 

d. The two are synonymous. 
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16. All too often Investigators state their null hypothesis 
merely as "the sauries did not differ." This leads to 
confusion because 

a. The sanples are not adequately described. 

b. The dependent variable is undefined. 

c. The analysis technique is unstated. 

d. The basic assunqptions of sampling are omitted. 

For each of the following research problems indicate which null 
hypothesis (I« II» or III) is most appropriate. 

17. An investigator wished to determine if right-handed or left- 
handed baseball pitchers revealed greater eccentricities as 
measured by Karl Olliver Obvious Key Induction Examination. 
He chose random samples of 50 right-handed and left-handed 
pitchers from rosters of the teams in the American, 

National, and Pacific Coast leagues. 



18. After selecting three random samples of sixth grade students, 
an investigator gave one group Intensive training in problem 
solving, a second group a similar amount of training in logic, 

no trainin" to a third group. He then tested the creative 
. abilities of the three nrours. 



19. An investigator wished to determine whether school admini- 
strators were more effective after completing his course. 

He watched his class members with other administrators in 
his state on the basis of sex, age, years of administrative 
es^erience, and number of hours of graduate credit. 



20. An investigator wished to verify his observation that hoys 
were more quantitatively Inclined than girls. He selected 
random samples of 10th grade boys and girls enrolled In 
his high school. 



Data Analysis II 
Criterion Examination 



For each of the following research situations describe the 
appropriate analysis techni^e. 

1* The investigator wished to determine ^idiether or not achieve- 
ment in arithmetic* as measured by a standardized test 
reporting scores in grade placement equivalents was related 
to nonverbal l.Q. 



2« An Investigator asked the question "is college attendance 
predicted by high school grade point average* size of 
graduating class* and SAX verbal scores?" 



3« A group of judges observed teaching behavior eidiiblted by 25 

student teachers and ranked them according to their effec- 
tiveness. The investigators wished to determine if these 

rankings were related to average grades in professional 
courses received by the subjects. 



4. An Investigator determined the validity of his test by 

showing that persons who scored higher on his test conq^leted 
their degree programs while those who scored lower did not 
complete their degrees* This relationship could best be 
described by: 



5. To evaluate the effectiveness of a set of instructional 
materials* the researcher administered pre- and poet- 
training tests (25-lten, nrultlple-cholce test) to a 
group of college freshnan English students* 



6. A college student personnel officer wished to know whether 
purchase of activities tickets differed among students 
living in dormitories* living in off-campus apartments 
or commuting from home* 
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7. Reaction times were recorded for three types of students, at 
four different tines of the day, under two tenqperature 
conditions for five consecutive days* 



8* A college political science professor was interested in 

determining Aether men or women tended to participate more 
frequently In antl**Vlet Nam demonstrations held on campuses* 
All students enrolled In political science courses were 
polled* 



9. A biology Instructor teaching two sections of bacteriology 
required weekly lab attendance for members of one class and 
conq>ared their performance on his final exam with performance 
of the second class which experienced no lab sessions* 



-jx 



o 




84 



10 • A sales tsanager was Interested In detenolning which of 
several characteristics (annual Incone, age^ size of 
family, etc.) were most accurate in differentiating 
C&diXXsc Isuydxs fxosi Gorvflir feuy©X8« 



11. A dean of women postulated that women enrolled In the College 
of Education were more attractive than women enrolled In the 
College of Arts and Sciences. Over a five year period she 
recorded the college affiliation of all women who were 
finalists in the 10 separate beauty contests held each year. 



12. A curious physiological psychology major wished to determine 
whether scholastic aptitude (SAT verbal score) was related 
to sex (male and female). 
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13. A college golf coach wished to determine whether there was a 
relationship between the order of finish in his conference 
tournament and season average scores of his team members. 



14. Ten pairs of identical twins were identified by a psycholo* 
gist. At random one twin from each pair was assigned to 
attend nursery school for one term. At the end of the term 
the psychologist obtained measures of social adaptivity for 
all 20 twins. Scores on the social adaptivity scale were 
such that they could be ranked in order of absolute 
magnitude. 



15. An investigator wishes to determine whether the 20 items on 
his test differ in difficulty. He administers the test to 
75 subjects and records pass-fail information for each itme 
for each subject. 



86 




An Investigator wished to determine whether there was any 
association between social class status and choice of high 
school curriculum. In a large hi^ school he recorded the 
number- of students in each of five social classes which 
chose each of three curricula. 
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Appendix G 
Written Evaluation 
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Appendix G 
Evaluation 

National Research Training Institute 

I. How were the "warm blanket" services— housing, food and drink, 
transportation, etc? 

Good I n - - * • • 

Weak In ^••* 

Suggested Improvement; 



2. How might the weekly schedule be Improved; Consider the a) balance 
between group activity and Independent study, b) time allowed 
for Informed discussion c) sequence of activities, etc. 



3. Rate the two presentations of each topic separately on a 5 point 
scale. 

5— Superlorj 4— Good; 5— About average; 2— Fair; I— Poor 

TOPICS the Written Section The Large Group 

In the Manual Presentation 
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I. Orientation and Overview | 

II. Specifying Behavioral 
Objectives 



ill. 


Objective Analysis and 
Struct lonal Specifi- 
cations 


IV. 


Measurement 


V. 


Instructional System 
Development 


VI. 


Research Design 


VII. 


Data Analysis i 


VIII. 


Data Analysis II 


IX, 


Proposal Writing 






I 



/ 






4. What "^s your react I on to the general Idea of a Research 
Train* ng Institute now that you have attended one? 



5. Any other comments? 
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